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(57)Abstract: 

PROBLEM TO BE SOLVED: To guarantee the 
sequence of update and the consistency of data by 
doubling data between disk subsystems on a main- 
center side and a remote- center side through gateway 
subsystems. 

SOLUTION: Data which are written from a host 
computer 1 are doubled between disk subsystems 3-1, 
3-2.. .3-n and a gateway subsystem 5 and held 
macroscopically in the same state. The gateway 
subsystem 5 adds information for holding the sequence 
of update. Further, the data are doubled between the 
gateway subsystem 5 and a gateway subsystem 7 by ^« 
asynchronous remote copying while the sequence of 
update is guaranteed. The disk subsystems 9-1, 9-2.. .9- 

n have the data updated in synchronism with the update of the gateway subsystem 7. Those 
are all actualized only by the function of the disk subsystems and no new software need not 
be introduced. 
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. * NOTICES * 

Japan Patent Office is not responsible for any 
. damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] It is the disk subsystem which it is the disk subsystem connected to the 1st external storage 
and the 2nd external storage, and data transfer between said 1st external storage is a synchronous type, 
and data transfer between said 2nd external storage is an asynchronous type, and is performed, 
respectively. 

[Claim 2] It is the integration system which it is the integration system which has a disk subsystem 
connected to high order equipment, the 1st external storage connected to said high order equipment, and 
said the 1st external storage and 2nd external storage, and data transfer between said 1st external storage 
of said disk subsystem is a synchronous type, and data transfer between said 2nd external storage is an 
asynchronous type, and is characterized by carrying out, respectively. 

[Claim 3] Said 2nd external storage is a disk subsystem according to claim 1 characterized by said 2nd 
external storage existing in a remote place, or an integration system according to claim 2 characterized 
by existing in a remote place. 

[Claim 4] It is the integration system according to claim 2 connected through a communication line 
between a disk subsystem according to claim 1 with which it connects through a communication line 
between said 2nd external storage or said disk subsystem, and said 2nd external storage. 
[Claim 5] An integration system according to claim 2 a disk subsystem according to claim 1 said whose 
the 1st and said 2nd external storage are a disk subsystem, respectively or said 1st [ the ], and said 
whose 2nd external storage are disk subsystems, respectively. 

[Claim 6] High order equipment The 1st external storage connected to said high order equipment The 
Maine pin center,large which has a disk subsystem connected to said the 1st external storage and 2nd 
external storage Said 2nd external storage connected to the 3rd external storage and said disk subsystem 
It is the integration system equipped with the above, and is characterized by updating sequence of data 
from said high order equipment turning into updating sequence of data over said 3rd external storage in 
a remote pin center,large. 

[Claim 7] It is the integration system which data transfer between said 1st external storage and said disk 
subsystems is a synchronous type, and data transfer between said 2nd external storage and said disk 
subsystems is an asynchronous type, and is performed in an integration system of said 6th publication, 
respectively. 

[Claim 8] An integration system according to claim 2 with which information about sequence is added 
to data on the occasion of said asynchronous data transfer on the occasion of a disk subsystem according 
to claim 1 with which information about sequence is added to data, or said asynchronous data transfer. 
[Claim 9] A disk subsystem according to claim 8 whose information about sequence added to said data 
is a serial number, or an integration system according to claim 8 whose information about sequence 
added to said data is a serial number. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention connects mutually two or more external 
storage groups (disk subsystem) which exist in a remote place especially, and two or more of other 
external storage groups about the external storage which stores the data of a computer system, and these 
integration systems, and relates to the remote copy technology which doubles data between the external 
storage (disk subsystem) which exists in a remote place, without going via a high order equipment slack 
host computer. Here, a disk subsystem shall mean the storage which contains the control section which 
delivers and receives information to high order equipment, and the disk unit which performs 
informational storing. 
[0002] 

[Description of the Prior Art] The enternal memory system which doubles and holds data between the 
disk subsystems currently installed in the Maine pin center,large and the remote pin center,large, 
respectively and which adopted the so-called remote copy function is already put in practical use partly. 
[0003] With this conventional technology, in order for a host computer to intervene and to attain the 
function of a remote copy, various technical problems occurred. 

[0004] A "synchronous type and asynchronous type 11 remote copy function is divided roughly into two 
kinds, a synchronous type and an asynchronous type. 

[0005] A synchronous type means the procedure which reports completion of an update process to the 
host computer of the Maine pin center,large, after directed updating (writing) is completed to the disk 
subsystem in the remote pin center,large which is the object of the remote copy function, when a disk 
subsystem has updating (writing) directions of data from the host computer in the Maine pin center,large 
(high order equipment) and the referent is also an object of a remote copy function. According to the 
geographical distance of the Maine pin center,large and a remote pin center,large, it is influenced of the 
capacity of the data transmission line which intervenes in the meantime, and time lags (transmission 
time etc.) occur. When the transmission time was taken into consideration, even if the synchronous type 
was called remote place, dozens of km was a limit actually. 

[0006] In the synchronous type, the content of the data of the disk subsystem of the Maine pin 
center,large and a remote pin center,large sees macroscopically, and is always in agreement. For this 
reason, since the condition of a just before [ disaster ] is saved thoroughly at the disk subsystem by the 
side of a remote pin center,large and it is even if it is the case where the Maine pin center,large loses a 
function according to disaster etc., there is an effect which can resume processing promptly by the 
remote pin center,large side. In addition, by seeing macroscopically, coincidence always means that data 
is surely in the same condition at the event of the completion of a data update process, although it is the 
unit (microsecondec, msec) of the processing time of a magnetic disk drive or an electronic circuitry and 
the condition of not being in agreement is possible during operation in a synchronous function. This is 
because an update process of the Maine pin center,large cannot be completed, unless reflection of the 
updating data to a remote pin center,large is completed. For this reason, especially, the distance of the 
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• Maine pin center,large and a remote pin center,large is separated, and when the data transmission line is 
congested, the access engine performance of the disk subsystem by the side of the Maine pin 
center,large deteriorates substantially. 

* [0007] On the other hand, as soon as an update process of the disk subsystem in the Maine pin 
center,large finishes even if the referent is an object of a remote copy function when a disk subsystem 
has updating (writing) directions of data from the host computer in the Maine pin center, large, an 
asynchronous type reports completion of an update process to a host computer, and means the procedure 
which performs processing [ in / in the renewal of the data in the disk subsystem of a remote pin 
center,large (reflection) / the Maine pin center,large ] to asynchronous. For this reason, since renewal of 
data is completed by the processing time needed inside the Maine pin center,large, the transmission time 
resulting from storing of the data to a remote pin center,large etc. does not start. 

[0008] The content of an asynchronous type of the disk subsystem of a remote pin center,large does not 
always correspond to it by the side of the Maine pin center,large. For this reason, when the Maine pin 
center,large loses a function according to disaster etc., the data which reflection of data has not 
completed to a remote pin center,large side will disappear. However, the access engine performance of 
the disk subsystem by the side of the Maine pin center,large can be made into the case where a remote 
copy function is not carried out, and equivalent level. 

[0009] If backup of the data in the case of natural disasters, such as an earthquake, is taken into 
consideration, it is necessary to separate the Maine pin center,large and a remote pin center,large 100km 
- about 100km of numbers. Moreover, although it is also possible to, use the high-speed communication 
line of 300 Mbit/sec classes from 100 Mbit/sec for example, for a remote copy function, the customer of 
a disk subsystem is made to pay the connection fees of a large sum, and it is not economical. 
[0010] "Sequentiality maintenance" When it is going to back up the Maine pin center,large which has 
two or more disk subsystems other than the technical problem of the transmission time of data in the 
remote pin center,large, the technical problem that each disk subsystem must correspond to 1 to 1 
(sequentiality maintenance) occurs. It is unavoidable that reflection of the updating data to a remote pin 
center,large is late for the generating event of a actual update process in the Maine pin center,large, and 
is processed by the asynchronous remote copy. However, the sequence of updating must be in 
agreement with the Maine pin center,large. 

[001 1] Generally, the data base etc. consists of a main part of a data base, various log information, and 
control information, and each has relevance. In the case of renewal of data, in addition to the main part 
of a data base, these log information and control information are also updated and the consistency of a 
system is maintained. Therefore, when the sequence of updating collapses, the consistency of such 
information relevant to updating sequence also collapses, and when the worst, it may lead to destruction 
of the whole data base. 

[0012] In realizing a remote copy asynchronous in the general environment where two or more disk 
subsystems exist in a "host computer intervenes" Maine pin center,large and a remote pin center,large, 
when a host computer directs renewal of data to a disk subsystem, it is common that add the information 
about updating sequence, such as a time stump, to data, and updating data reflection processing of the 
disk subsystem of sub** is performed based on such information. For example, like the XRC (Extended 
Remote Copy) function of IBM, the host computer intervened and the remote copy function is realized. 
[0013] Concrete disclosure of a XRC function is made by JP,6-290125,A (U.S. Pat. No. 5446871) at 
details. In a XRC function, cooperation of the operating system of the host computer by the side of the 
Maine pin center,large, a disk subsystem, and the data mover software of the host computer by the side 
of a remote pin center,large and a disk subsystem has realized issuance of updating sequence 
information, sending, and updating data reflection processing based on this. 
[0014] 

[Problem(s) to be Solved by the Invention] An asynchronous remote copy function is realizable with the 
conventional technology (XRC function), guaranteeing the updating sequentiality between the Maine 
pin center,large and a remote pin center,large. However, with the conventional technology, the structure 
for XRC functional implementation is required for the both sides of high order software and a disk 
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• subsystem, and both have to cooperate. Since the new software of dedication needs to be introduced, the 
activity of reexamination of the system design accompanying installation of software, setting out, 
inspection, and the increment in a CPU load etc. generates a user. For this reason, the predetermined 
period was required for installation of the conventional function, and there was an introductory 
obstruction that costs occurred. 

[0015] Moreover, when the capacity of a communication line with a remote pin center,large was not 
enough and the asynchronous remote copy function was performed, the technical problem that non- 
reflected updating data increased to a remote pin center,large occurred. 

[0016] The object of this invention does not need installation of new software, but is only the function of 
a disk subsystem, can guarantee the sequentiality of updating, and the consistency of data, and is 
realizing an asynchronous remote copy function with little degradation of the Maine pin center,large 
with easy and installation. 

[0017] Another object of this invention is applying an asynchronous remote copy function to the disk 
subsystem which can perform mass data storage, and it is to realize a remote copy function, without 
making the customer of a disk subsystem pay the connection fees of a large sum. 
[0018] 

[Means for Solving the Problem] One disk subsystem (a henceforth, gateway subsystem) which serves 
as the gateway, respectively is arranged in the Maine pin center,large which exists mutually in a remote 
place, and each remote pin center,large, and a gateway subsystem is connected to them on the data 
transmission line. And all disk subsystems that need to carry out a remote copy of both pin center,larges 
are connected to each gateway subsystem in a pin center,large. 

[0019] Between volume set as the object of a remote copy of a disk subsystem of the Maine pin 
center,large, and volume of arbitration of a gateway subsystem in the Maine pin center,large, it connects 
by the synchronous remote function and data is doubled. Thereby, in volume of a disk subsystem for [ in 
the Maine pin center,large ] a remote copy, and volume of a gateway subsystem in the Maine pin 
center,large, if delay of the processing time of a system etc. can be disregarded, the same data will be 
held. 

[0020] Between each volume of a gateway subsystem of the Maine pin center,large and a remote pin 
center,large, data is doubled by the asynchronous remote copy. However, according to sequence that 
volume in a self subsystem was updated, as for a gateway subsystem of the Maine pin center,iarge, 
updating data is reflected in volume in a self subsystem according to sequence from which updating data 
was sent to a gateway subsystem of a remote pin center,large, and a gateway subsystem of a remote pin 
center,large received it. 

[0021] Data is doubled by the synchronous remote copy between each volume of a gateway subsystem 
in a remote pin center,large, and each disk subsystem. Thereby, in volume of a gateway subsystem by 
the side of a remote pin center,large, and volume of a disk subsystem for a remote copy, it sees 
macroscopically and the same data is always held. 

[0022] In addition, data of volume for a remote copy is stored in buffer memory in a gateway subsystem 
of self in a gateway subsystem. Therefore, area of a subsystem for data storage is not usually necessarily 
needed other than buffer memory. However, if there is area of an available subsystem, area of a 
subsystem which is needed according to capacity of the transmission line in the case of data 
transmission and reception which went via the transmission line can be used. 
[0023] It is realizable with the above configuration, maintaining the sequentiality of updating of 
doubleness of data of two or more disk subsystems of the Maine pin center,large, and two or more disk 
subsystems of a remote pin center,large only by function of a disk subsystem. Reflection of updating 
data to a remote pin center,large can be carried out to asynchronous with an update process of each disk 
subsystem of the Maine pin center,large. Thereby, easy disaster backup system of installation can be 
offered with high performance. Moreover, according to channel capacity of the transmission line, 
suitably, area of a subsystem can be used and there is an effect which can mitigate a customer's 
connection-fees burden. 
[0024] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi__ejje 



3/11/2004 



Page 4 of 6 



' [Embodiment of the Invention] Hereafter, an example at the time of applying this invention to a general- 
purpose computer system is explained, referring to a drawing. 

[0025] In two or more data centers which equipped drawing 1 with the general-purpose computer 
system, in order to double data between two pin center,larges of arbitration, the example of a 
configuration when applying this invention is shown. 

[0026] One set or two or more sets of one set or two or more sets of the disk subsystems by the side of 
the Maine pin center,large, and the disk subsystems by the side of a remote pin center,large were 
connected through the Gateway subsystem, without minding a host computer, and the remote copy 
system which doubles data among both pin center,larges is realized. 

[0027] the Maine pin center,large 12 of drawing 1 setting — a central processing unit (host computer) 

1 - the interface cable 2 — minding - a disk subsystem 3-1, 3-2, and it connects with 3-n. a disk 

subsystem 3-1, 3-2, and 3-n stores the data referred to or updated from a host computer 1 . The 

gateway subsystem 5 is connected with 3-n from a disk subsystem 3-1 through an interface cable 4, 
[0028] The gateway subsystem 5 will write the data concerned also in the buffer memory in a self 
subsystem synchronizing with this, if a host computer publishes the write request of data in disk 
subsystem 3-1 grade. Furthermore, with data having been written in the buffer memory in a self 
subsystem, write-in directions of data are performed to asynchronous to the gateway subsystem 7 which 
exists in a remote place. The gateway subsystem 5 surely consists of disk subsystems 3-1 irrespective of 
the number of 3-n at one set. 

[0029] The gateway subsystem 7 is installed in the remote pin center,large 13, and is connected with the 
gateway subsystem 5 of the Maine pin center,large 12 through the interface cable 6. In addition, the 
interface cable 6 can also be connected with a general communication line. This example describes as an 
interface cable 6 also including this point. The gateway subsystem 7 is stored in the buffer memory in a 
self subsystem at order with write-in directions of the data received from the gateway subsystem 5. The 
gateway subsystem 7 surely consists of one set. 

[0030] a disk subsystem 9-1, 9-2, and 9-n is connected with the gateway subsystem 7 through the 

interface cable 8. Disk subsystem 9-1 grade writes in the data concerned also in a self subsystem 
synchronizing with this, when the write request of data is in the gateway subsystem 7 from the Maine 
pin center,large 12. 

[0031] That is, from a host computer 1, when there are write-in directions of data to 3-n from one set or 
two or more sets of disk subsystems 3-1, the same data also as 9-n is stored from one set or two or more 
sets of the disk subsystems 9-1 in the remote pin center,large 13. The arrow head of drawing 1 shows the 
data flow which had write-in directions from the host computer 1. 

[0032] A host computer 1 1 is a central processing unit which is connected with 9-n by the interface 
cable 10 from a disk subsystem 9-1 in the remote pin centerjarge 13, and performs reference and 
updating to disk subsystem 9-1 grade. A host computer 1 1 can be processed by becoming an alternative 
of a host computer 1, when it becomes impossible for the host computer 1 of the Maine pin center,large 
12 to achieve an original function by disaster, failure, etc. In addition, the data stored in the disk 
subsystem 9-1 grade can be used, and processing which is different in the host computer 1 of the Maine 
pin center,large 12 can be performed separately [ a host computer 1 ] independently. However, when a 
host computer 1 1 does not process to disk subsystem 9-1 grade, the host computer 1 1 is unnecessary. 
[0033] As a gestalt of operation of this invention, the doubleness method of data and the outline of 
employment are explained using drawing 2 and drawing 3 . 

[0034] An employment person chooses in advance the volume in which the data set as the object of 
doubleness was stored, a data set, and a disk subsystem. And the employment person sets up beforehand 
the relation between object volume, an object data set and a disk subsystem, and the volume which 
stores the duplicate of selected data, a data set and a disk subsystem from the host computer to the disk 
subsystem. 

[0035] The above-mentioned selection and setting out are faced, and in the case of the disk subsystem 
which can connect or equip the console and service processor of dedication, a host computer is not used, 
but it can set to it through the console and service processor. The flow of drawing 2 shows the case 
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■ where selection and setting out are performed from a host. 
[0036] The method of specifying the concrete address meaning above-mentioned volume and an above- 
mentioned disk subsystem as the setting-out method, and the method of choosing from the range of the 
arbitration of the address with the control program in a disk subsystem can also be taken. As initial 
setting, the example which performs pass setting out and pair setting out is shown ( drawing 2 , 201 ). 
[0037] from a host computer 1 ( drawing 1 ), the write request (henceforth, light command) of data 

publishes to a disk subsystem 3-1, 3-2, , 3-n (211) - having ( drawing 2 , 202) - A disk subsystem 

3-1, 3-2, , 3-n publish the light command of the data to the gateway subsystem 5 (212), performing 

data storage processing into a self disk subsystem based on a light command (203). Here, a light 
command is a command which transmits the directions for writing in data, and the write-in data itself. 
[0038] The gateway subsystem's 5 receipt of a light command performs processing to a light command 
(204). If the data storage processing to the light command to the buffer memory in the gateway 
subsystem of self is completed, the gateway subsystem 5 will report completion of processing to a disk 

subsystem 3-1, 3-2, , 3-n (211). In connection with this, the light command number is given to the 

order which processing completed for every light command (205), and the light command with which 
the light command number was given is published to the gateway subsystem 7 (213) by the opportunity 
determined based on the throughput of a self subsystem to a light command numerical order (206). 
[0039] On condition that the processing to the light command, i.e., data storage processing into a self 

subsystem, is completed to the disk subsystem 3-1, 3-2, , light command in which 3-n (211) was 

published from the host computer 1 and completion of write-in processing is reported from the gateway 
subsystem 5 (212) (221), the completion report (222) of the processing to a light command is performed 
to a host computer 1. 

[0040] A check of that the gateway subsystem 7 (213) has received the light command to the given 
numerical order by the light command number given to the light command published from the gateway 
subsystem 5 (212) performs the processing to a light command, i.e., the data storage processing to the 
buffer memory in a self subsystem, (301). In connection with this, the light command of the data is 
published to a disk subsystem 9 (31 1) (302). A disk subsystem's 9 (311) receipt of the light command 
published from the gateway subsystem 7 performs the processing to a light command, i.e., data storage 
processing into a self subsystem, (303). 

[0041] Completion of a disk subsystem 9-1, 9-2, , processing of as opposed to a light command in 9- 

n (31 1), i.e., the data storage processing to the buffer memory in a self subsystem, performs the 
completion report (321) of processing to the gateway subsystem 7. Data storage processing into a self 
subsystem completes the gateway subsystem 7 (213), and on condition that completion of write-in 

processing is reported [ a disk subsystem 9-1, 9-2, , ] from 9-n, the completion report (322) of 

processing to a light command is performed to the gateway subsystem 5. 

[0042] It doubles a disk subsystem 3-1, 3-2, , between 3-n and the gateway subsystem 5, and the 

data written in from the host computer 1 is seen macroscopically, and is always maintained at the same 
condition by this invention. In this case, the information (serial number) for holding the sequence of 
updating in the Gateway subsystem 5 is added. 

[0043] Moreover, doubleness of data is performed by the asynchronous remote copy between the 
gateway subsystem 5 and the gateway subsystem 7, guaranteeing the sequence of updating. As for a disk 

subsystem 9-1, 9-2, , 9-n, data is updated synchronizing with renewal of the gateway subsystem 7. 

Including the disk subsystem which has a Gateway function, it realizes only by the function of a disk 
subsystem and these all do not serve as a burden to the throughput of a host computer. 
[0044] The buffer field in each Gateway subsystem is used for drawing 4 , and actuation when the 
channel capacity of the transmission line is not enough is explained to it. It is shown that the same sign 
is already explanation ending. In this system, the buffer field which stores data with a write request 
temporarily is prepared in each Gateway subsystem. It is for preventing that the buffer memory in the 
usual transmission line overflows. The data of the subsystem stored in this buffer field is sent to a 
remote pin center,large from the Maine pin center,large through the transmission line, and is inputted 
into a Gateway subsystem through the buffer field by the side of a remote pin center,large there. If it 
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carries out like this, although whenever [ doubleness time coincidence ] will decrease, ** can also 

realize an asynchronous remote copy function without a mass communication line. 

[0045] 

[Effect of the Invention] Installation of new software is not needed, but only by the function of a disk 
subsystem, the sequentiality of updating and the consistency of data can be guaranteed, installation is 
easy and an asynchronous remote copy system without lowering of the processability ability of the 
Maine pin center,large can be realized. 

[0046] Moreover, according to the channel capacity of the transmission line, suitably, the area of a 
subsystem can be used and there is an effect which can mitigate a customer's connection-fees burden. 



[Translation done.] 
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